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© Applied motion analysis and design. 



© Methods of forming a numerical control program 
for a machine tool, computer animation, animal train- 
ing, human skill development, robot programming 
and sport motion development. 

The methods involve constructing a 
human/animal body model, applying actual 
human/animal movements to it and analysing the 
input movements using inverse dynamics. Further 
desired movements are then calculated using dy- 
namics on the various segments of the body in- 
dependently of one another, then applying known 
constraints governing the actual possible motion of 

^ m each segment, and then analysing the corrected 

^ motion again using inverse dynamics. 




CM 

O 

Q. 
LU 



Rank Xerox (UK) Business Services 



EP 0 520 099 A1 



This invention relates to methods of applying a 
new method of analysing and designing motions 
which may be carried out using a computer. 

Specific applied methods include methods for 
forming a numerical control program for a machine 
tool or similar device, achieving and developing a 
computer animation, analysing and training the mo- 
tions of animals, programming a robot to imitate 
the motions of a human being or other animal, 
analysing and improving motions carried out in 
sports, and developing skills for use e.g. in the 
industrial and performing arts. 

All of these aspects may usefully apply the 
novel methods of processing which have been de- 
veloped by the present inventors. In particular, the 
present processes relate to applying the recorded 
movements of an actual human or animal to a 
human or animal model stored in a computer 
database, and analysing the applied motions using 
inverse dynamics to obtain force, torque and centre 
of gravity data for various sections of the body 
concerned. A proposed motion can then be entered 
using simple dynamic principles for each section, 
without complicating the process by taking into 
account the other constraints on each section e.g. 
that two parts of the same leg must in fact remain 
connected. After the calculation, these additional 
constraints can then be applied to the model and a 
viable motion "produced" which itself is then an- 
alysabie using inverse dynamic calculation. The 
last steps may be repeated interactively to produce 
a satisfactory result which can be displayed. 

Various practical aspects embodying this new 
method or processing image/model data are set 
out in the claims. 

In the prior art, disclosures relating to motion 
design may usefully be referred to in US-A- 
4807108, US-A-4744026, US-A-4744027 and US-A- 
4744028. Reference is also made to the article 
"Dynamic Analysis-Based Human Animation" by 
the present inventors, a copy of which has been 
filed with this application for contemporaneous pub- 
lication. The disclosure of this article is incorpo- 
rated herein by reference. 

Various aspects embodying the invention are 
now described with reference to the accompanying 
drawings in which: 

Fig. 1 is a flow chart illustrating a general meth- 
od; 

Fig. 2 are control graphs, exemplifying forces 
exerted in the three axial directions at a body 
joint; 

Figs. 3(a) and 3(b) are schematic views of a 
display obtainable using dynamics; 
Figs 4(a) and 4(b) are schematic views of a 
display obtainable using inverse dynamics; 
Figs. 5 and 6 correspond to Figs. 3 and 4, in the 
case of an animal movement, and 



Figs. 7 and 8 are corresponding schematic dis- 
plays in respect of a human sporting movement. 
This aspect relates to a method for forming a 
numerical control program for a machine tool or 
5 similar device. 

Modern machine tools are frequently controlled 
by numerical control programs. Recently, in nu- 
merical control techniques, systems known as CAE 
systems or CIM systems have been utilized. In 
io these system, design is performed using CAD pro- 
cesses and production is performed using CAM 
processes. 

Since numerical control techniques do not 
specify working requirements such as the direction 

15 of the working operation, the magnitude of the 
force to be applied to the workpiece, or the working 
speed, it is impossible with these techniques to 
achieve the same quality as can be achieved by a 
skilled craftsman manually controlling a machine 

20 tool. 

Furthermore, while the formation of numerical 
control programs is preferably performed by a 
method having real time response, conventional 
numerical control programming methods have no 

25 real time response because they require the ascer- 
tainment of the contents by means of motion sim- 
ulation and fine adjustment at the work site. 

In order to perform high quality manufacturing 
by means of numerical control, it is necessary to 

30 analyze the motions of a human machine operator 
and form a control program on the basis of the 
analysis. However, in the past, since unreliable 
knowledge based on the intuition of the program- 
mer was used, the resulting control program was 

as unsatisfactory. Furthermore, since kinematics, 
which describes motions in terms of positions, ve- 
locities, and accelerations, was used to analyze 
and design motions of a machine tool, the resulting 
motions were apt to be incorrect. Thus, with con- 

40 ventional methods, it was difficult to construct a 
numerical control program using only a computer. 

Another method referred to as dynamics pro- 
vides motions of an object based on the relation 
between movements and forces. If dynamics is 

45 applied to the construction of a numerical control 
program, it is possible to program complex behav- 
ior with minimal control. Furthermore, dynamics 
has the great advantage that it can construct pro- 
grams which could never be obtained utilizing kine- 

so matics. However, dynamics has the problem that it 
is necessary to know the moment of inertia, the 
center of gravity, joint friction, and muscle and 
ligament elasticity of the human body, which are 
difficult io measure. 

55 Furthermore, programming methods utilizing 

dynamics are not suitable because of their com- 
putational complexity, since when n is the number 
of segments in the numerical control program, 
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each acting as a minimal unit of motion, the com- 
putational complexity 0(f(n)) becomes a function 
0(n A ) of n 4 , and thus is very large, so calculation 
requires a long time. 

A method of forming a numerical control pro- 
gram having a computational complexity of 0(n) 
has been proposed- However, this method is ap- 
plicable only when there are no rotations of joints 
about the principal axes, so it finds very limited 
applications. 

It would be desirable to provide an method for 
forming a numerical control program which can 
develop new motions for a machine tool using 
knowledge obtained by dynamic analysis of the 
motions of a human being. 

It would also be desirable to provide an im- 
proved method for forming a numerical control 
program by computer in an interactive manner 
without relying on trial and error or the intuition of 
the programmer. 

In a method for forming a numerical control 
program according to the present aspect , basic 
motions of a human being are analyzed to obtain 
data on dynamic parameters including the forces 
and torque exerted on joint of the human body, and 
this data is put into a database. A programmer then 
accesses the database and modifies the data, and 
a computer provides the programmer with feed- 
back in real time on the result of constraints in 
terms of constrained motions and the result of 
inverse dynamics in terms of forces. The program- 
mer can design new motions in an interactive man- 
ner by repeating the above processes until sat- 
isfactory results are obtained. 

The computational complexity of the method of 
the present invention is a function 0(n) of the 
number of segments n, so the computational com- 
plexity is much less than with conventional pro- 
gramming methods. 
Figures 1 is a flow chart of the method. 
It includes the following steps. 

(1) Constructing a model of the human body; 

(2) Applying the actual motions of a human to 
the model; 

(3) Analyzing the resulting motions of the model; 

(4) Designing new motions; 

(5) Applying dynamics; 

(6) Applying constraints; 

(7) Applying inverse dynamics; and 

(8) Displaying the result. 

In the first step (constructing a model), the 
human body is divided into a plurality of segments 
connected by joints, each of the segments acting 
as a minimal unit of motion, and a model is con- 
jee tac r en Ihe basis of constraints including the 
nature of each segment, the articulation of the 
body, and the range of movement of the joints 
connecting the segments. Data defining the model 



is stored in a computer as a database. 

In the second step (applying actual motions), a 
film is taken of the actual motions of a human, and 
for each frame of the film, the positions of the body 
5 parts of the human are quantified and input to the 
computer. This data is applied to the model, and 
the computer calculates the position, velocity, and 
acceleration of each segment of the model. When 
the human is simultaneously filmed from a plurality 
70 of directions, the analysis in the next step can be 
executed more concretely. 

In the third step (analyzing the motions of the 
model), the motions of the segments determined in 
the second step are analyzed using inverse dy- 
75 . namics to determine the center of gravity of each 
body segment, the force and torque exerted on 
each joint, the position of the center of gravity of 
the whole body, and the force and torque exerted 
on the center of gravity of the whole body. This 
20 data is then put into the database. 

Next, a method for forming a numerical control- 
program on the basis of the above analysis will be 
described. 

In the fourth step (designing new motions), a 

25 programmer chooses a plurality of basic motions 
from the database. One way of quantitatively repre- 
senting the motions is by means of control graphs 
showing the forces acting on one of the joints of 
the model as a function of time. Figures 2(a) - 2(c) 

30 are control graphs of the forces acting on e.g. left 
elbow of a golfer in the directions of x, y, and z 
orthogonal axes as a function of time. The data 
constituting the control graphs is stored in the 
database. The two forces exerted on any given 

35 joint are equal in magnitude and opposite in direc- 
tion. A complicated motion is represented by a 
plurality of graphs. The control graphs for motions 
of other body segments can be designed in the 
same manner as for the illustrated control graphs 

40 for the left elbow. 

On the basis of the control graphs, a numerical 
control program is created. In this case, physical 
parameters involving scaling up or down of the 
abscissa or ordinate of the control graphs are 

45 modified in accordance with the dimensions and 
material of a workpiece and the working range of 
the machine tool. 

In the fifth step (application of dynamics), the 
motion of each element of the machine tool is 

so calculated on the basis of the forces corresponding 
to the basic motions selected by the developer and 
dynamic equations. Although the elements of the 
machine tool are actually connected with one an- 
other by joints, in order to simplify the calculations, 

55 it is assumed for the moment [hat each element is 
independent of the other elements. 

The linear acceleration of each element is cal- 
culated using Newton's equation of motion, and the 
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angular acceleration of each element is calculated 
using Euler's equations. Once the linear and an- 
gular accelerations are obtained, they are inte- 
grated a first time to find velocities and integrated a 
second time to find positions. 5 

In the sixth step (application of constraints), the 
articulation of the machine elements and the range 
of the movements of the joints connecting the 
elements are checked for each of the motions 
calculated in the fifth step. The process of applying ro 
constraints starts at a element referred to as a root 
element, and the position and the orientation of 
each element in a subclass of the root element are 
checked sequentially. Here, two types of checks 
are performed. One is a check whether a subclass 75 
element is always connected to its superclass ele- 
ment. The other is a check whether the movement 
of each joint exceeds a specified range. If the 
subclass element is not connected to its superclass 
element, the subclass element is translated until it 20 
becomes connected to its superclass element. If 
the movement of any joint exceeds the specified 
range, the movement of the joint is adjusted to be 
within the range by rotation of the corresonding 
element. 25 

In the seventh step (application of inverse dy- 
namics), Lagrange equations which describe the 
relationship between forces and movement are 
used to calculate the forces exerted on each joint 
connecting the machine elements. 30 

If the desired results are not at first obtained, 
the 5th - 7th steps can be repeated, and the new 
motions can be developed in an interactive man- 
ner. 

In the eighth step (displaying the result), the 35 
new motions which have been partially or com- 
pletely designed are displayed on a screen. 

In the present invention, since the sequence is 
executed by a simple line feedback algorithm, the 
computational complexity of the inverse dynamics 40 
becomes a function O(n) of the number of ele- 
ments n. 

Furthermore, the present invention makes it 
possible for a programmer to design a new motion 
of a machine tool in an interactive manner using a 45 
computer without requiring trial and error or the 
intuition of the programmer. 

As mentioned above, the method according to 
the present invention comprises the steps of ana- 
lyzing the basic motions of a human being and 50 
forming a new numerical control program using 
dynamics. The analysis of the basic motions of a 
human being is achieved in three steps: construct- 
ing a model, aoplying the actual motions of a 
h^man being to the model, and analyzing the re- 55 
suiting motions of the model. The formation of the 
program is achieved in three steps: application of 
dynamics, application of constraints, and applica- 



tion of inverse dynamics. In the step of applying 
dynamics, the machine tool is divided into a plural- 
ity of independent elements connected by joints, 
and the motion of each element is calculated in- 
dependently of the other elements using Newton's 
equation of motion and Euler's equations. In the 
step of applying constraints, the articulation of the 
elements of the machine and the range of move- 
ment of its joints are checked. In the step of 
applying inverse dynamics, the force modified by 
the constraints and generating new forces are cal- 
culated. Thus, the whole computational complexity 
becomes O(n). 

This aspect relates to a method for developing 
computer animation. 

Increasingly realistic and aesthetically pleasing 
computer animation has been achieved by taking 
into consideration the physical properties of the 
moving objects represented by the animation and 
the physical principles that govern the movement 
of the objects. 

One computer animation method which was 
recently proposed employs kinematics, in which 
motions are described in terms of position, veloci- 
ties, and accelerations, and forces and torques 
involved in the motions are ignored. However, in 
animation utilizing kinematics, the animator must 
specify the motions involved with precision, and 
the information necessary to do so may not be 
readily available to the animator. 

Another recently developed animation tech- 
nique utilizes dynamics, which provides the mo- 
tions of an object based on the relation between 
motions and forces. If this method is used to create 
computer animation, it is possible to generate com- 
plex behavior with minimal control. Furthermore, an 
animation method utilizing dynamics has the great 
advantage that it can avoid the limitations of motion 
specification of methods utilizing kinematics. 

However, an animation method utilizing dynam- 
ics requires data on dynamic parameters such as 
the moments of inertia, the centers of mass, joint 
friction, and muscle/ligament elasticity of the mov- 
ing body being represented by the animation, and 
these parameters are difficult to measure. Without 
such data, animation based on dynamics produces 
unrealistic motions similar to animation based on 
kinematics. Furthermore, dynamics requires the 
solving of extensive equations. For an articulated 
human body with 200 degrees of freedom, 600 
simultaneous differential equations need to be 
solved. 

Thus, animation methods which have been pro- 
posed thus far are not well suited for representing 
complex motions. 

Therefore, there is no animation method capable of 
representing all the motions of a human or animal. 
There has been some research on the use of 
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artificial intelligence and expert systems to capture 
the knowledge and skills of the animator. Other 
animation methods that have been suggested in- 
clude a constraint-based approach and a frame- 
based approach. 

In conventional animation methods, basic data 
on the motions of humans or animals, such as the 
dimensions of body parts, moments of inertia, and 
constraints that define the range of movement of 
individual joints is determined by the animator rely- 
ing on his intuition. 

Conventional animation methods utilizing dy- 
namics to represent the movements of a human 
body, for example, involve the following steps. 

(1) Constructing a model of the human body; 

(2) Applying the actual motions of a human to 
the model; 

(3) Analyzing the motions of the model; 

(4) Creating a new motion; and 

(4) Displaying the new motion on a screen. 
In the fourth step (creating a new motion), a 
method which can exactly solve the dynamic equa- 
tions using the Gibbs formula is particularly suit- 
able. However, for an actual animation system, this 
method has not been used because of its complex- 
ity, since when n is the number of segments con- 
stituting the model and forming minimal units of 
motion, the computational complexity 0(f(n)) be- 
comes a function 0(n 4 ) of n + , and thus is very 
large. 

There has also been proposed an animation 
method which reduces the computational complex- 
ity of 0(n) by neglecting rotations of joints about 
the principal axes. However, with this method, only 
a line picture is possible, and a realistic three- 
dimensional model of an articulated body cannot 
be obtained. 

As mentioned above, practical animation work 
requires a method have real time response, but 
conventional animation techniques require much 
trial and error and do not permit real time re- 
sponse. 

It would be desirable to provide an animation 
developing method utilizing dynamics which en- 
ables an animator to design motions in an inter- 
active manner based on the actual motions of a 
human or animal body without requiring trial and 
error or the intuition of an animator. 

It would also be desirable to provide an anima- 
tion developing method which can generate a re- 
alistic three-dimensional modeling picture. 

It would furthermore be desirable to provide an 
animation developing method which can represent 
all the motions of a human or animal bodv. 

In an animation developing method according 
to the present aspect, the basic movements of a 
human or animal body are analyzed to generate 
data on dynamic parameters including the forces 



and torques exerted on joints of the body. This 
data is stored in a database. In order to design a 
new motion, an animator accesses the database 
and modifies the data. A computer provides the 

5 animator with feedback on constraints in terms of 
constrained motions and the result of inverse dy- 
namics in terms of forces so that the animator can 
design new motions in an interactive manner by 
repeating the above processes until satisfactory 

iq results are obtained. 

The computational complexity of an animation 
developing method according to the present inven- 
tion is reduced to a function 0(n) wherein n is the 
number of segments, so the time required for com- 

75 putations is greatly reduced compared to conven- 
tional methods. Furthermore, the present invention 
can illustrate the motions of human or animal bod- 
ies by smooth three-dimensional modeling pictures 
without requiring trial and error or the intuition or 

20 the animator. 

Figure 1 is a flow chart of the animation devel- 
oping method of the present aspect when used to 
develop animation of a human body. It includes the 
following steps. 

as (1) Constructing a model of the human body; 

(2) Applying the actual motions of a human to 
the model; 

(3) Analyzing the resulting motions of the model; 

(4) Developing new motions from basic motions; 
30 (5) Applying dynamics to the model; 

(6) Applying constraints to the model; 

(7) Applying inverse dynamics to the model; and 

(8) Displaying the result. 

In the first step (constructing a model), the 

35 human body is divided into a plurality or segments 
connected by joints, each of the segments acting 
as a minimal unit of motion. A model is then 
constructed on the basis of constraints including 
the nature of each segment, the articulation of the 

40 body, and the range of movement of the joints 
connecting the segments. Data defining the model 
is stored in a computer as a database. 

In the second step (applying actual motions), a 
film is taken of the actual motions of a human, and 

45 for each frame of the film, the positions of the body 
parts of the human are quantified and input to the 
computer. This data is applied to the model, and 
the computer calculates the position, velocity, and 
acceleration of each segment of the model. When 

so the human is simultaneously filmed from a plurality 
of directions, the analysis in the next step can be 
executed more concretely. 

In the third step (analyzing the motions of the 
model\ the motions of the segments determined in 

55 the second step are analyzed using inverse dy- 
namics to determine the center of gravity of each 
body segment, the force and torque exerted on 
each joint, the position of the center of gravity of 
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the whole body, and the force and torque exerted 
on the center of gravity of the whole body. When 
only the analysis of motions is desired, the center 
of gravity of each body segment, the force and 
torque exerted on each joint the center of gravity 
of the whole body, and the force and torque ex- 
erted on the center of gravity of the whole body, 
which are obtained in the third step, are displayed 
on a screen by arrows or other symbols superim- 
posed on a display of the human body model. 

Next, a method for designing a new motion 
based on the results of the above analysis will be 
explained. 

In order to design a new motion, the data on 
the human body obtained in the first step, the data 
on the actual motions of the human body obtained 
in the second step, and the data on the results of 
the analysis obtained in the third step are pre- 
viously input to the database. 

In the fourth step (designing new motions), an 
animator chooses a plurality of basic motions from 
the database. The motions are represented quan- 
titatively by control graphs each showing the force 
acting on one of the joints of the model as a 
function of time. Figures 2(a) - 2(c) are control 
graphs of the forces acting in the directions of x, y, 
and z orthogonal axes on the left elbow of a person 
performing a movement in Shorinji Kempo (a mar- 
tial art) as a function of time. The two forces 
exerted on any given joint are equal in magnitude 
and opposite in direction. A complicated motion is 
represented by a plurality of graphs. The control 
graphs for motions of other body segments can be 
designed in the same manner as for the illustrated 
control graphs for the left elbow. 

Next, global modification and local modification 
of forces are performed. Global modification in- 
volves producing a uniform change in forces acting 
on all the body segments. Local modification in- 
volves the modification of physical parameters 
such as the force exerted on a specific segment of 
the human body. 

In the fifth step (application of dynamics), the 
motion of each body segment is calculated on the 
basis of the forces corresponding, to the basic 
motions selected by the animator and the dynamic 
equations governing movement of the segment. In 
this calculation, although the articulation of the hu- 
man body is essentially as shown in Figure 3(a), 
each body segment is treated as being separate 
from the others to reduce the amount of computa- 
tion, and the constraints on the articulation of the 
human body and the range of movement of joints 
are neglected for the moment. 

In orcer to caicuiate cne motion of each seg- 
ment, Newton's equation of motion is used to de- 
termine the linear acceleration of the center of 
gravity, and Euler's equations are used to derive 



the angular acceleration of each segment about its 
center of gravity. Once the linear and angular ac- 
celerations are obtained, they are integrated a first 
time to find velocities and integrated a second time 
5 to find positions. 

In the sixth step (application of constraints), the 
articulation of the human body and the range of the 
movements of body joints are checked for each of 
the motions calculated in the fifth step. The pro- 
10 cess of applying constraints starts at a segment 
referred to as a root segment, and the position and 
the orientation of each segment in a subclass of 
the root segment are checked sequentially. Here, 
two types of checks are performed. One is a check 
75 whether a subclass segment is always connected 
to its superclass segment. The other is a check 
whether the movement of each joint exceeds a 
specified range. If the subclass segment is not 
connected to its superclass segment as shown in 
20 Figure 4(a), the subclass segment is translated until 
Jt becomes connected to its superclass segment. If 
the movement of each joint exceeds the specified 
range, the movement of the joint is adjusted to be 
within the range by rotation of the corresponding 
25 segment, thus modifying the positions of the seg- 
ments to obtain a posture as shown in Figure 4(b). 

In the seventh step (application of inverse dy- 
namics), Lagrange equations which describe the 
relationship between forces and movement are 
• 30 used to calculate the forces exerted on each joint 
of the body. 

If the desired results are not at first obtained, 
the 5th - 7th steps can be repeated, and the new 
motions can be developed in an interactive man- 
35 ner. 

In the eighth step (displaying the result), the 
new motions which have been partially or com- 
pletely designed are displayed on the screen. The 
position of the center of gravity of the displayed 

40 human body and the direction of forces exerted 
thereon can be superimposed on the human body. 

In the present invention, since the sequence is 
executed by a simple line feedback algorithm, the 
computational complexity of the inverse dynamics 

45 becomes a function 0(n) of the number of seg- 
ments n. By using inverse dynamics, a reasonable 
and complete combination of forces can be ob- 
tained. In contrast, without inverse dynamics, it is 
impossible for the animator to find the complete 

so design of forces. In the present invention, if the 
orientation of a body segment is such that the 
range of movement of either of its joints is ex- 
ceeded, the orientation of the segment is changed 
so that the position of the body segment satisfies 

55 the physical constraints of the human body. Since 
the motions of the human body thus obtained are 
natural motions wherein a subclass segment is 
always connected to its superclass segment and 
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the movement of each joint does not exceed the 
specified range, such motions can be displayed 
realistically using a three-dimensional modeling 
picture. 

Furthermore, according to the present inven- 
tion, it is possible to develop a new motion in an 
interactive manner using a computer without requir- 
ing trial and error or the intuition of the animator. 

Animation of an animal body can be developed 
by the method of the present invention in the same 
manner as described above with respect to a hu- 
man body. 

As mentioned above, the animation developing 
method according to the present invention com- 
prises the steps of analyzing the basic motions of 
an actual human body and developing new mo- 
tions. The analysis of the basic motions of the 
human body is achieved in three steps: construct- 
ing a model of the human body, applying the 
actual motions of a human to the model, and 
analyzing the motions of the segments of the 
model. The development of new motions is 
achieved in three steps: application of dynamics, 
application of constraints, and application of inverse 
dynamics. In the step of applying dynamics, the 
human body is divided into a plurality of indepen- 
dent body segments (50, for example) connected 
by joints, and the motion of each body segment is 
calculated independently of the other segments 
using Newton's equation of motion and Euier's 
equations, tn the step of applying constraints, the 
articulation of the body and the range of movement 
of its joints are checked. In the step of applying 
inverse dynamics, the force modified by the con- 
straints and generating new forces are calculated. 
Thus, the whole computational complexity be- 
comes O(n). 

Accordingly, the method according to the 
present invention can eliminate the computational 
complexity of conventional methods, it permits dy- 
namics to be applied to actual animation develop- 
ment, and it permits feedback in real time using 
dynamics. 

Furthermore, in order to calculate the motions 
of each segment of the human body, since the 
linear acceleration of the center of gravity is cal- 
culated using Newton's equation of motion and the 
angular acceleration of the center of gravity is 
calculated using Euier's equations, it is possible to 
determine and display not only the position of and 
the force exerted on the center of gravity of each 
segment, but also the position of and the force 
exerted on the center of gravity of the whole hu- 
man body. 

It is possible according to the present invention 
to realistically display the motions of a human body 
using smooth three-dimensional modeling pictures 
rather than line drawings. In addition, an animator 



can look at the human body model on the screen 
from various directions, and can translate or rotate 
various segments of the human body in an inter- 
active manner. Thus, the animator can ascertain 
5 the relationship between the picture and the human 
body model correctly. 

In conventional animation developing methods, 
basic data on the motions of the human body and 
the constraints that define the range of movements 

/o of individual joints is obtained using the intuition of 
the animator. In contrast, in the animation develop- 
ing method according to the present invention, 
actual dynamic parameters are obtained by analyz- 
ing the actual motions of the human body. Accord- 

75 ingly, the motions derived from these parameters 
are reliable and provide realistic motions. 

An object-oriented paradigm has recently been 
used in a number of areas. As a user interface, the 
object-oriented philosophy leads to a direct ma- 

20 nipulation paradigm. In this direct manipulation 
paradigm, since the images displayed on a screen 
correspond to objects, by using the animation de- 
veloping method according to the present inven- 
tion, the objects can be manipulated directly in the 

25 space of the objects. 

The above-described processes for analyzing 
motions and developing new motions according to 
the present invention can be applied not only to the 
development of animation but to programming of 

30 industrial equipment such as robot control systems, 
to numerical control systems, to the study of mo- 
tions in sports or the performing arts, and to the 
training of animals. 

This aspect relates to an animal training meth- 

35 od, and more particularly to a method for analyzing 
the motions of an animal which is to be trained to 
perform a physical movement. 

In order to train an animal such as a dog or 
horse, it is first necessary to analyze the motions of 

40 the animal. In the past, a trainer observed the 
motions of a skilled animal and then formed a 
training program on the basis of his observations. 
However, because observations are subjective, 
they may not give accurate results. 

45 There has recently been proposed a technique 

wherein the motions of an animal are analyzed 
using a computer, and a trainer can then use the 
computer analysis to teach the animal a motion or 
develop a new motion. However, such computer 

so analysis is not reliable because it uses data which 
depend upon the subject of analysis. Further, since 
the analysis is performed utilizing kinematics, 
which describes the motions in terms of positions, 
velocities, and accelerations, only a tine picture 

55 representing the parts constituting the animal body 
can be displayed on a screen, and a three-dimen- 
sional model of the animal body cannot be dis- 
played realistically. Accordingly, it is difficult both 
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to understand the contents displayed and to de- 
velop a new motion. 

Furthermore, while computer analysis of mo- 
tions to develop a new motion preferably utilizes a 
method having real time response, the conventional 
methods have no real time response because they 
require the ascertainment of the contents of actual 
motions and fine adjustment based on the results. 

Conventional computer notion analysts utilizing 
dynamics involves the following steps. 

(1) Constructing a model of an animal body; 

(2) Applying the actual motions of an animal to 
the model; 

(3) Analyzing the motions of the model; and 

(4) Reproducing the analyzed motions. 

In the fourth step (reproducing the analyzed 
motions), the dynamic equations may be solved 
exactly. However, this method is not suitable be- 
cause of its conceptual and computational com- 
plexity, since when n is the number of segments 
constituting the animal body model and forming the 
minima) units of motion in the motion analysis, the 
number or calculations, i.e.. the computational 
complexity 0(f(n)) becomes a function 0(n 4 ) of n\ 
and thus is very large, so calculation requires a 
long time. 

It would be desirable to provide an animal 
training method which enables a trainer to analyze 
the motions of an animal using a computer and 
develop a new motion in an interactive manner 
without requiring a process of trial and error or the 
intuition of the trainer. 

In order to achieve the above object, according 
to an animal training method of the present aspect, 
the basic motions of an animal body are analyzed 
to obtain data on dynamic parameters including the 
forces and torques exerted on joints of the animal 
body, and such data are put into a database as 
knowledge regarding the basic motions. 

In order to develop a new motion, a trainer 
accesses the database and modifies the data. A 
computer can provide the trainer with feedback in 
real time on the result of constraints and on the 
result of inverse dynamics, and new motions can 
be developed in an interactive manner by repeating 
the above processes until satisfactory results are 
obtained. 

The computational complexity in this animal 
training method is a function O(n) of the number of 
segments n in the model, so the computational 
complexity is greatly reduced. Furthermore, it is 
possible to develop new motions by computer in 
an interactive manner without requiring trial and 
error or the intuition of the trainer and to realisti- 
ca!!y display motions of the animal body using a 
three-dimensional smooth modeling picture. 

Figures 1 is a flow chart of the method of the 
present aspect. It includes the following steps. 



(1) Constructing an animal body model; 

(2) Applying the actual motions of an animal to 
the model; 

(3) Analyzing the resulting motions of the model; 
5 (4) Developing new motions from basic motions; 

(5) Applying dynamics to the model; 

(6) Applying constraints to the model; 

(7) Applying inverse dynamics to the model; and 

(8) Displaying the result. 

10 ,r > the first step (constructing an animal body 

model), the animal body is divided into a plurality 
of segments connected by joints, each of the seg- 
ments acting as a minimal unit of motion. An ani- 
mal body model is then constructed on the basis of 

'5 constraints including the nature of each segment, 
the articulation of the body, and the range of move- 
ment of the joints connecting the segments. Data 
defining the model are stored in a computer as a 
database. 

20 In the second step (applying actual motions), a 

film is taken of the actual motions of an animal, and 
for each frame of the film, the positions of the body 
parts of the animal are quantified and input to the 
computer. This data is applied to the model, and 
25 the computer calculates the position, velocity, and 
acceleration of each segment of the model. When 
the animal is simultaneously filmed from a plurality 
of directions, the analysis in the next step can be 
executed more concretely. 
30 ln the third step (analyzing the motions of the 

model), the motions of the segments determined in 
the second step are analyzed using inverse dy- 
namics to determine the center of gravity of each 
body segment, the force and torque exerted on 
35 each joint, the position of the center of gravity of 
the whole body, and the force and torque exerted 
on the center of gravity of the whole body. When 
only the analysis of motions is desired, the center 
of gravity of each body segment, the force and 
40 torque exerted on each joint the center of gravity 
of the whole body, and the force and torque ex- 
erted on the center of gravity of the whole body, 
which are obtained in the third step, are displayed 
on a screen by arrows or other symbols superim- 
45 posed on a display of the animal body model. 

Next, a method for developing a new motion on 
the basis of the results of the preceding analysis 
will be explained. 

In order to develop a new motion, the data on 
so the animal body obtained in the first step, the data 
on the actual motions of the animal body obtained 
in the second step, and the data on the results of 
the analysis obtained in the third step are pre- 
viously input to the database. 
55 ln the fourth step (developing new motions), a 

developer chooses a plurality of basic motions 
from the database. The basic motions are repre- 
sented quantitatively by control graphs each show- 
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ing the force acting on one of the joints of the 
model as a function of time. Figures 2(a) - 2(c) are 
control graphs of the forces acting on a joint in the 
directions of x, y, and z orthogonal axes as a 
function of time. The two forces exerted on any 
given joint are equal in magnitude and opposite in 
direction. A complicated motion is represented by 
a plurality of graphs. 

Next, global modification and local modification 
of forces are performed. Global modification in- 
volves producing a uniform change in forces acting 
on ail the body segments. Local modification in- 
volves the modification of physical parameters 
such as the force exerted on a specific segment of 
the animal body. 

In the fifth step (application of dynamics), the 
motion of each body segment is calculated on the 
basis of the forces corresponding to the basic 
motions selected by the developer and the dy- 
namic equations governing movement of the seg- 
ment. In this calculation, although the articulation of 
the animal body is essentially as shown in Figure 
5(a), each body segment is treated as being sepa- 
rate from the others to reduce the amount of com- 
putation, and the constraints on the articulation of 
the animal body and the range of movement of 
joints are neglected for the moment. 

In order to calculate the motion of each seg- 
ment, Newton's equation of motion is used to de- 
termine the linear acceleration of the center of 
gravity, and Euler's equations are used to derive 
the angular acceleration of each segment about its 
center of gravity. Once the linear and angular ac- 
celerations are obtained, they are integrated a first 
time to find velocities and integrated a second time 
to find positions. 

In the sixth step (application of constraints), the 
articulation of the animal body and the range of the 
movements of body joints are checked for each of 
the motions calculated in the fifth step. The pro- 
cess of applying constraints starts at a segment 
referred to as a root segment, and the position and 
the orientation of each segment in a subclass of 
the root segment are checked sequentially. Here, 
two types of checks are performed. One is a check 
whether a subclass segment is always connected 
to its superclass segment- The other is a check 
whether the movement of each joint exceeds a 
specified range. If the subclass segment is not 
connected to its superclass segment as shown in 
Figure 6(a), the subclass segment is translated until 
it becomes connected to its superclass segment. If 
the movement of each segment joint exceeds the 
specified range, the movement of the joint is ad- 
justed ;c be vO".:;: :he rang? by "ctation of *.hs 
corresponding segment, thus modifying the posi- 
tions of the segments to obtain a posture as shown 
in Figure 6(b). 



In the seventh step (application of inverse dy- 
namics), Lagrange equations which describe the 
relationship between forces and movement are 
used to calculate the forces exerted on each joint 
5 of the body. 

If the desired results are not at first obtained, 
the 5th - 7th steps can be repeated, and the new 
motions can be developed in an interactive man- 
ner. 

w In the eighth step (displaying the result), the 

hew motions which have been partially or com- 
pletely designed are displayed on the screen. The 
position of the center of gravity of the displayed 
animal body and the direction of forces exerted 

75 thereon can be superimposed on the animal body. 
Furthermore, in the displaying step, the results 
obtained in the third step in which the motions of 
the model are analyzed can also be displayed. 

In the present invention, since the sequence is 

20 executed by a simple line feedback algorithm, the 
computational complexity of the inverse dynamics 
becomes a function O(n) of the number of seg- 
ments n. By using inverse dynamics, a reasonable 
and complete combination of forces can be ob- 

25 tained. In contrast, without inverse dynamics, it is 
impossible for the developer to find the complete 
design of forces. In the present invention, if the 
orientation of a body segment is such that the 
range of movement of either of its joints is ex- 

30 ceeded, the orientation of the segment is changed 
so that the position of the body segment satisfies 
the physical constraints of the animal body. Since 
the motions of the animal body thus obtained are 
natural motions wherein a subclass segment is 

35 always connected to its superclass segment and 
the movement of each joint does not exceed the 
specified range, such motions can be displayed 
realistically using a three-dimensional modeling 
picture. 

40 Furthermore, according to the present inven- 

tion, it is possible to develop a new motion in an 
interactive manner using a computer without requir- 
ing trial and error or the intuition of the developer. 
As mentioned above, the animal training meth- 

45 od according to the present invention comprises 
the steps of analyzing the basic motions of an 
actual animal body and developing new motions. 
The analysis of the basic motions of the animal 
body is achieved in three steps: constructing an 

so animal body model, applying the actual motions of 
an animal to the model, and analyzing the motions 
of the segments of the model. The development of 
new motions is achieved in three steps: application 
of dynamics, application of constraints, and ap- 

55 plication of inverse dynamics. !n the step of apply- 
ing dynamics, the animal body is divided into a 
plurality of independent body segments (50, for 
example) connected by joints, and the motion of 
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each body segment is calculated independently of 
the other segments using Newton's equation of 
motion and Euler's equations. In the step of apply- 
ing the constraints, the articulation of the body and 
the range of movement of the joints are checked. s 
In the step of applying inverse dynamics, the force 
modified by the constraints and generating new 
forces are calculated. Thus, the whole computa- 
tional complexity becomes O(n). 

Accordingly, the method according to the ;o 
present invention can eliminate the computational 
complexity of conventional methods, it permits dy- 
namics to be applied to actual animal training, and 
it permits feedback in real time using dynamics. 

Furthermore, in order to calculate the motions rs 
of each segment of the animal body, since the 
linear acceleration of the center of gravity is cal- 
culated using Newton's equation of motion and the 
angular acceleration of the center of gravity is 
calculated using Euler's equations, it is possible to 20 
determine and display not only the position of and 
the force exerted on the center of gravity of each 
segment, but also the position of and the force 
exerted on the center of gravity of the whole animal 
body. In other words, since the position of the 25 
center of gravity of the animal body and the direc- 
tion and magnitude of the forces involved in the 
movement can be displayed, it is possible to easily 
train the animal. 

It is possible according to the present invention 30 
to realistically display the motions of an animal 
body using smooth three-dimensional modeling 
pictures rather than line drawings. In addition, a 
trainer can look at the animal body model on the 
screen from various directions, and can translate or 35 
rotate various segments of the animal body in an 
interactive manner. Thus, the analyst can ascertain 
the relationship between the picture and the animal 
body model correctly. 

In conventional animal training methods, basic aq 
data on the motions of the animal body and the 
constraints that define the range of movements of 
individual joints are obtained using the intuition of 
the analyst. In contrast, in the animal training meth- 
od according to the present invention, actual dy- 45 
namic parameters are obtained by analyzing the 
actual motions of the animal body. Accordingly, the 
motions derived from these parameters are reliable 
and provide realistic motions. 

This aspect relates to a method for program- 50 
ming a robot to imitate the motions of a human 
being or animal under the control of a computer. 

Recently, industrial robots have come to be 
used in various fields to perform a wide variety of 
pnysicai monons. Programming a robot involves a 55 
process known as teaching. One teaching method 
is an on-line programming method known a 
"teaching playback" in which the motions of a 



human are directly taught to the robot. Another 
method is an off-line programming method in which 
the motions of a human being are simulated by a 
computer. 

In the teaching playback method, a person 
moves a robot in accordance with a working se- 
quence by manual control. This method is widely 
adopted because it is easy to perform, but it has 
the disadvantage that the operation of the robot 
must be stopped during the teaching process, 
thereby lowering the working efficiency of the ro- 
bot. The off-line programming method is useful 
when a high working efficiency is required, be- 
cause the programming can be performed without 
stopping the operation of the robot. 

Generally, in the off-line programming method, 
the contents of tracks and movement scheduled by 
environmental models are described by a robot 
programming language, the contents, are ascer- 
tained by motion simulation, and fine adjustment of 
the contents is later performed at the work site. 
Thus, the off-line programming method is very 
complicated. Since the environmental models in- 
clude geometrical information such as configura- 
tions, dimensions, positions, and postures of the 
work piece and peripheral equipment, physical pa- 
rameters such as materials and weights, and tech- 
nical information such as functions, service, and 
usage, a programmer must schedule the working 
sequence by using such complex environmental 
models. 

In order to control a robot to perform the mo- 
tions of a human being, it is necessary to analyze 
the motions of a human being and then design 
motions to be performed by the robot. In the past, 
since inaccurate knowledge based on the intuition 
of the motion analyst was used to design robot 
motions, the resulting motions of the robot were 
unsatisfactory. Furthermore, since kinematics, 
which describes motions in terms of positions, ve- 
locities, and accelerations, was used to analyze 
and design motions, the design process was very 
difficult. 

In addition, while it is desirable to design the 
motions of a robot using a method have real time 
response, conventional off-line programming meth- 
ods have no real time response because they 
require the ascertainment of the contents of mo- 
tions by means of motion simulation and fine ad- 
justment at the work site, which requires trial and 
error. 

Another method known as dynamics is also 
applied to robot programming. Dynamics provides 
the motions of an object based on the relation 
between movement and forces. If dynamics is ap- 
plied to robot programming, it is possible to pro- 
gram, complex behavior with minimal control. Fur- 
thermore, robot programming utilizing dynamics 



10 



19 



EP 0 520 099 A1 



20 



can design new motions which can never be ob- 
tained using kinematics. 

The disadvantages of dynamics have been 
mentioned. 

A robot programming method having a com- 
putational complexity of O(n) has been proposed. 
However, this method is applicable only when there 
are no rotations of joints about the principal axes. 

It would be desirable to provide an improved 
robot programming method utilizing dynamics 
which can program complicated working se- 
quences. 

It would also be desirable to provide an im- 
proved robot programming method which can pro- 
duce new motions of a robot using knowledge 
based on analysis using dynamics of actual mo- 
tions of the human body. 

Furthermore it would be desirable to provide a 
robot programming method which enables a pro- 
grammer to develop a new motion in an interactive 
manner without relying on trial and error or the 
intuition of the programmer. 

In a robot programming method according to 
the present invention, basic motions of a human 
being are analyzed to obtain data on dynamic 
parameters including the forces and torque exerted 
on joints of the human body, and this data is put 
into a database. A programmer then accesses the 
database and modifies the data, and a computer 
provides the programmer with feedback in real 
time on the result of constraints in terms of con- 
strained motions and the result of inverse dynam- 
ics in terms of forces. The programmer can design 
new motions in an interactive manner by repeating 
the above processes until satisfactory results are 
obtained. 

The computational complexity of the motion 
analyzing method employed in the present inven- 
tion is a function 0(n) of the number of segments 
n, so the computational complexity is much less 
than with conventional programming methods. Fur- 
thermore, the present method can produce natural 
motions of a robot. 

Figures 1 is a flow chart of the method of the 
present aspect. It includes the following steps. 

(1) Constructing a model of the human body; 

(2) Applying the actual motions of a human to 
the model; 

(3) Analyzing the resulting motions of the model; 

(4) Designing new motions; 

(5) Applying dynamics; 

(6) Applying constraints; 

(7) Applying inverse dynamics; and 

(8) Displaying the result. 

In the first step (constructing a model), the 
human body is divided into a plurality of segments 
connected by joints, each of the segments acting 
as a minimal unit of motion. A model is then 



constructed on the basis of constraints including 
the nature of each segment, the articulation of the 
body, and the range of movement of the joints 
connecting the segments. Data defining the model 
5 is stored in a computer as a database. 

In the second step (applying actual motions), a 
film is taken of the actual motions of a human, and 
for each frame of the film, the positions of the body 
parts of the human are quantified and input to the 

70 computer. This data is applied to the model, and 
the computer calculates the position, velocity, and 
acceleration of each segment of the model. When 
the human is simultaneously filmed from a plurality 
of directions, the analysis in the next step can be 

75 executed more concretely. 

In the third step (analyzing the motions of the 
model), the motions of the segments determined in 
the second step are analyzed using inverse dy- 
namics to determine the center of gravity of each 

20 body segment, the force and torque exerted on 
each joint, the position of the center of gravity of 
the whole body, and the force and torque exerted 
on the center of gravity of the whole body. This 
data is then put into the database. 

25 Next, a method for programming a robot to 

perform a new motion on the based on the results 
of the preceding analysis will be described. 

In the fourth step (designing new motions), a 
programmer chooses a plurality of basic motions 

30 from the database. One way of quantitatively repre- 
senting the motions is by means of control graphs 
showing the forces acting on one of the joints of 
the model as a function of time. Figures 2(a) - 2(c) 
are control graphs of the forces acting on the left 

35 elbow of a golfer in the directions of x, y, and z 
orthogonal axes as a function of time. The data 
constituting the control graphs is stored in the 
database. The two forces exerted on any given 
joint are equal in magnitude and opposite in direc- 

40 tion. A complicated motion is represented by a 
plurality of graphs. The control graphs for motions 
of other body segments can be designed in the 
same manner as for the illustrated control graphs 
for the left elbow. 

45 On the basis of the control graphs, a program 

for a robot is created. In this case, physical param- 
eters involving scaling up or down of the abscissa 
or ordinate of the control graphs are modified in 
accordance with the dimensions and material of a 

so work piece to be handled by the rotor and the 
working range of the robot. 

In the fifth step (application of dynamics), the 
motion of each segment of the robot is calculated 
on the basis of the forces corresponding to the 

55 basic motions selected by the developer and the 
dynamic equations governing movement of the 
segment. Although the segments of the robot body 
are in fact connected with one another by joints, in 
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order to simplify the calculations, it is assumed for 
the moment that each segment of the robot is 
independent of the other segments. 

The linear acceleration of each segment is 
calculated using Newton's equation of motion, and 5 
the angular acceleration of each segment is cal- 
culated using Euler's equations. Once the linear 
and angular accelerations are obtained, they are 
integrated a first time to find velocities and in- 
tegrated a second time to find positions. 7C 

In the sixth step (application of constraints), the 
articulation of the segments of the robot and the 
range of the movements of its joints are checked 
for each of the motions calculated in the fifth step. 
The process of applying constraints starts at a 75 
segment referred to as a root segment, and the 
position and the orientation of each segment in a 
subclass of the root segment are checked sequen- 
tially. Here, two types of checks are performed. 
One is a check whether a subclass segment is 20 
always connected to its superclass segment. The 
other is a check whether the movement of each 
joint exceeds a specified range. If the subclass 
segment is not connected to its superclass seg- 
ment as shown in Figure 4(a), the subclass seg- 25 
ment is translated until it becomes connected to its 
superclass segment. If the movement of each seg- 
ment joint exceeds the specified range, the move- 
ment of the joint is adjusted to be within the range 
by rotation. 3Q 

In the seventh step (application of inverse dy- 
namics), Lagrange equations which describe the 
relationship between forces and movement are 
used to calculate the forces exerted on each joint 
of the robot body. 3g 

If the desired results are not at first obtained, 
the 5th - 7th steps can be repeated, and the new 
motions can be developed in an interactive man- 
ner. 

In the eighth step (displaying the result), the aq 
new motions which have been partially or com- 
pletely designed are displayed on the screen. 

In the present invention, since the sequence is 
executed by a simple line feedback algorithm, the 
computational complexity of the inverse dynamics 45 
becomes a function O(n) of the number of seg- 
ments n. 

Furthermore, the present invention makes it 
possible for a programmer to design a new motion 
of a robot in an interactive manner using a com- 50 
puter without requiring trial and error or the intuition 
of the programmer. 

As mentioned above, the robot programming 
method according to the present invention com- 

rises :r,e steps of analyzing the basic motions of a 55 
human being and forming a new robot program 
using dynamics. The analysis of the basic motions 
of a human being is achieved in three steps: con- 



structing a model, applying the actual motions of a 
human being to the model, and analyzing the re- 
sulting motions of the model. The formation of the 
program is achieved in three steps: application of 
dynamics, application of constraints, and applica- 
tion of inverse dynamics. In the step of applying 
dynamics, the robot body is divided into a plurality 
of independent segments connected by joints, and 
the motion of each segment is calculated indepen- 
dently of the other segments using Newton's equa- 
tion of motion and Euler's equations. In the step of 
applying constraints, the articulation of the robot 
body and the range of movement of the joints are 
checked. In the step of applying inverse dynamics, 
the forces modified by the constraints and generat- 
ing new forces are calculated. Thus, the whole 
computational complexity becomes O(n). 

This aspect relates to a method for analyzing a 
physical motion used in performing a sport 
(hereinafter referred to as a sport motion) in order 
to develop a curriculum for teaching the motion. 

In order to teach a sport motion, it is first 
necessary to analyze the motion. In the past, a 
trained analyst observed the motions of a skilled 
athlete and then formed a curricular for learning the 
motion based on his observations. However, be- 
cause the observations are subjective, they may 
unreliable. Furthermore, since the development of a 
new sport motion is performed by trial and error, it 
can be very time consuming. 

There has recently been proposed a technique 
wherein a motion of an athlete is analyzed using a 
computer, and a trainer can then use the computer 
analysis to train an unskilled person to perform the 
motion. The computer analysis can also be used to 
develop a new motion. The computer analysis uti- 
lizes kinematics, which describes the motions in 
terms of positions, velocities, and accelerations us- 
ing data which depends upon the subject of analy- 
sis. Therefore, only a line picture of the human 
body can be displayed on a screen, and a three-' 
dimensional model of the human body cannot be 
displayed realistically. Accordingly, it is difficult to 
understand the display and to develop a new mo- 
tion. 

Furthermore, while computer analysis of mo- 
tions to develop a new motion preferably utilizes a 
method having real time response, conventional 
computer analysis methods have no real time re- 
sponse because they require the ascertainment of 
the contents of actual motions and fine adjustment 
based on the results. 

Another method referred to as dynamics pro- 
vides the motions of an object based on the rela- 
tion between movements and forces. The disad- 
vantages have been described above. 

It would be desirable to provide a sport motion 
developing method which can analyze the motions 
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of a human using a computer and develop a new 
sport motion in an interactive manner without re- 
quiring trial and error or the intuition of an analyst. 

In order to achieve the above object, according 
to a sport motion developing method of the present 5 
aspect, the basic motions of a human body are 
analyzed to obtain data on dynamic parameters 
including the forces and torques exerted on joints 
of the human body and such data are put into a 
database as knowledge regarding the basic mo- 10 
tions. 

In order to develop a new motion, a trainer 
accesses the database and modifies the data. A 
computer can provide the trainer with feedback in 
real time on the result of constraints and on the /s 
result of inverse dynamics, and new motions can 
be developed in an interactive manner by repeating 
the above processes until satisfactory results are 
obtained. 

The computational complexity in this sport mo- 20 
tion developing method is a function O(n) of the 
number of segments n in the model, so the com- 
putational complexity is greatly reduced. Further- 
more, the present invention allows a trainer to 
develop a new motion by computer in an inter- 25 
active manner without requiring trial and error or 
his intuition, and motions of the human body can 
be realistically displayed using a three-dimensional 
smooth modeling picture. 

Figures 1 is a flow chart of the method of the 30 
present aspect. It includes the following steps. 

(1) Constructing a model of the human body; 

(2) Applying the actual motions of a human to 
the model; 

(3) Analyzing the resulting motions of the model; 35 

(4) Developing new motions from basic motions; 

(5) Applying dynamics to the model; 

(6) Applying constraints to the model; 

(7) Applying inverse dynamics to the model; and 

(8) Displaying the result. 40 
In the first step (constructing a model), the 

human body is divided into a plurality of segments 
connected by joints, each of the segments acting 
as a minimal unit of motion. A model is then 
constructed on the basis of constraints including 45 
the nature of each segment, the articulation of the 
body, and the range of movement of the joints 
connecting the segments. Data defining the model 
are stored in a computer as a database. 

In the second step (applying actual motions), a so 
film is taken of the motions of an actual human, 
and for each frame of the film, the positions of the 
body parts of the human are quantified and input to 
the computer. This data is applied to the model, 
and \ t ~° % ?~p'_. z: calculates the position, velocity, 55 
and acceleration of each segment of the model. 
When the human is simultaneously filmed from a 
plurality of directions, the analysis in the next step 



can be executed more concretely. 

In the third step (analyzing the motions of the 
model), the motions of the segments determined in 
the second step are analyzed using inverse dy- 
namics to determine the center of gravity of each 
body segment, the force and torque exerted on 
each joint, the position of the center of gravity of 
the whole body, and the force and torque exerted 
on the center of gravity of the whole body. When 
only the analysis of motions is desired, the center 
of gravity of each body segment, the force and 
torque exerted on each joint, the center of gravity 
of the whole body, and the force and torque ex- 
erted on the center of gravity of the whole body, 
which are obtained in the third step, are displayed 
on a screen by arrows or other symbols superim- 
posed on a display of the human body model. 

Next, a method for developing a new motion on 
the basis of the results of the preceding analysis 
will be explained. 

In order to develop a new motion, the data on 
the human body model obtained in the first step, 
the data on the actual motions of the human body 
obtained in the second step, and the data on the 
results of the analysis obtained in the third step are 
previously input to the database. 

in the fourth step (developing new motions), a 
developer chooses a plurality of basic motions 
from the database. The basic motions are repre- 
sented quantitatively by control graphs each show- 
ing the force acting on one of the joints of the 
model as a function of time. Figures 2(a) - 2(c) are 
control graphs of the forces acting on the left elbow 
of e.g. a golfer in the directions of x/y, and z 
orthogonal axes as a function of time. The two 
forces exerted on any given joint are equal in 
magnitude and opposite in direction. A complicated 
motion is represented by a plurality of graphs. The 
control graphs for motions of other body segments 
can be designed in the same manner as for the 
illustrated control graphs for the left elbow. 

Next, global modification and local modification 
of forces are performed. Global modification in- 
volves producing a uniform change in forces acting 
on all the body segments. Local modification in- 
volves the modification of physical parameters 
such as the force exerted on a specific segment of 
the human body. 

In the fifth step (application of dynamics), the 
motion of each body segment is calculated on the 
basis of the forces corresponding to the basic 
motions selected by the developer and the dy- 
namics equations governing movement of the seg- 
ment. In this calculation, although the articulation of 
;he human bocy is ess en nail y as shown in Figure 
3(a). each body segment is treated as being sepa- 
rate from the others to reduce the amount of com- 
putation, and the constraints on the articulation of 
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the human body and the range of movement of 
joints are neglected for the moment. 

In order to calculate the motion of each seg- 
ment, Newton's equation of motion is used to de- 
termine the linear acceleration of the center of 
gravity, and Euler's equations are used to derive 
the angular acceleration of each segment about its 
center of gravity. Once the linear and angular ac- 
celerations are obtained, they are integrated a first 
time to find velocities and integrated a second time 
to find positions. 

In the sixth step (application of constraints), the 
articulation of the human body and the range of the 
movements of body joints are checked for each of 
the motions calculated in the fifth step. The pro- 
cess of applying constraints starts at a segment 
referred to as a root segment, and the position and 
the orientation of each segment in a subclass of 
the root segment are checked sequentially. Here, 
two types of checks are performed. One is a check 
whether a subclass segment is always connected 
to its superclass segment The other is a check 
whether the movement of each joint exceeds a 
specified range. If the subclass segment is not 
connected to its superclass segment as shown in 
Figure 8(a), the subclass segment is translated until 
it becomes connected to its superclass segment. If 
the movement of each segment joint exceeds the 
specified range, the movement of the joint is ad- 
justed to be within the range by rotation, thus 
modifying the positions of the' segments to obtain a 
posture as shown in Figure 8(b). 

In the seventh step (application of inverse dy- 
namics), Lagrange equations which describe the 
relationship between forces and movement are 
used to calculate the forces exerted on each joint 
of the body. 

If the desired results are not at first obtained, 
the 5th - 7th steps can be repeated, and the new 
motions can be developed in an interactive man- 
ner. 

In the eighth step (displaying the result), the 
new motions which have been partially or com- 
pletely designed are displayed on the screen. The 
position of the center of gravity of the human body 
and the direction of forces exerted thereon can be 
superimposed on the display of the human body. 
Furthermore, in the displaying step, the results 
obtained in the third step in which the motions of 
the model are analyzed can also be displayed. 

In the present invention, since the sequence is 
executed by a simple line feedback algorithm, the 
computational complexity of the inverse dynamics 
becomes a function Q(n) of the number of seg- 
ments n. By using inverse aynamics, a reasonade 
and complete combination of forces can be ob- 
tained. In contrast, without .inverse dynamics, it is 
impossible for the developer to find the complete 



design of forces. In the present invention, if the 
orientation of a body segment is such that the 
range of movement of either of its joints is ex- 
ceeded, the orientation of the segment is changed 
so that the position of the body segment satisfies 
the physical constraints of the human body. Since 
the motions of the human body thus obtained are 
natural motions wherein a subclass segment is 
always connected to its superclass segment and 
the movement of each joint does not exceed the 
specified range, such motions can be displayed 
realistically using a three-dimensional modeling 
picture. 

Furthermore, according to the present inven- 
tion, it is possible to develop a new motion in an 
interactive manner using a computer without requir- 
ing trial and error or the intuition of the developer. 

As mentioned above, the sport motion develop- 
ing method according to the present invention 
comprises the steps of analyzing the basic motions 
of an actual human body and developing new mo- 
tions. The analysis of the basic motions of the 
human body is achieved in three steps: construct- 
ing a human body model, applying the actual mo- 
tions of a human to the model, and analyzing the 
motions of the segments of the model. The devel- 
opment of new motions is achieved in three steps: 
application of dynamics, application of constraints, 
and application of inverse dynamics. In the step of 
applying dynamics, the human body is divided into 
a plurality of independent body segments (50, for 
example) connected by joints, and the motion of 
each body segment is calculated independently of 
the other segments using Newton's equation of 
motion and Euler's equations. In the step of apply- 
ing the constraints, the articulation of the body and 
the range of movement of the joints are checked. 
In the step of applying inverse dynamics, the force 
modified by the constraints and generating new 
forces are calculated. Thus, the whole computa- 
tional complexity becomes O(n). 

Accordingly, the method according to the 
present invention can eliminate the computational 
complexity of conventional methods, it permits dy- 
namics to be applied to actual sport motion devel- 
opment, and it permits feedback in real time using 
dynamics. 

Furthermore, in order to calculate the motions 
of each segment of the human body, since the 
linear acceleration of the center of gravity is cal- 
culated using Newton's equation of motion and the 
angular acceleration of the center of gravity is 
calculated using Euler's equations, it is possible to 
determine and disolay not only the position of and 
the force exerted on the center of gravity of each 
segment, but also the position of and the force 
exerted on the center of gravity of the whole hu- 
man body. In other words, since the position of the 
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center of gravity of the human body and the direc- 
tion and magnitude of the forces involved in the 
movement can be displayed, it is possible to easily 
teach the motion being developed. 

It is possible according to the present invention 
to realistically display the motions of a human body 
using smooth three-dimensional modeling pictures 
rather than line drawings. In addition, a trainer can 
look at the human body model on the screen from 
various directions, and can translate or rotate var- 
ious segments of the human body in an interactive 
manner. Thus, the analyst can ascertain the rela- 
tionship between the picture and the human body 
model correctly. 

In conventional sport motion developing meth- 
ods, basic data on the motions of the human body 
and the constraints that define the range of move- 
ments of individual joints are obtained using the 
intuition of the analyst. In contrast, in the- sport 
motion developing method according to the present 
invention, actual dynamic parameters are obtained 
by analyzing the actual motions of the human 
body. Accordingly, the motions derived from these 
parameters are reliable and provide realistic mo- 
tions. 

This aspect relates to a skill developing meth- 
od for analyzing various skills in the industrial and 
performing arts and forming curricula for teaching 
the skills. 

In order to teach new skilfs in the industrial and 
performing arts, it is necessary to analyze the 
motions involved in the skill and then form curricula 
for teaching the motions. In the past, an analyst 
observed the technique of an expert in the skill to 
be taught and then formed a teaching curriculum 
on the basis of his observations. However, because 
observations are subjective, the results may not be 
reliable. 

There has recently been proposed a method 
wherein a skill is analyzed using a computer, and a 
teacher can then use the computer analysis to train 
an unskilled person to perform the skill. The com- 
puter analysis utilizes kinematics, of which the dis- 
advantages have been described above. 

Furthermore, while computer analysis of mo- 
tions for developing a new skill preferably utilizes a 
method having real time response, conventional 
computer analysis methods have no real time re- 
sponse because they require the ascertainment of 
the contents of actual motions and fine adjustment 
based on the results. 

Another method referred to as dynamics pro- 
vides the motions of an object based on the rela- 
tion between movements and forces. The disad- 
vantages and complexities -thereof hava been men- 
tioned. 

It would be desirable to provide a skill develop- 
ing method which can analyze the motions of a 
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human using a computer and develop a new skill in 
an interactive manner without requiring trial and 
error or the intuition of an analyst. 

In order to achieve the above object, in a skill 

5 developing method of the present invention, the 
basic motions of a human body are analyzed to 
obtain data on dynamic parameters including the 
forces and torques exerted on joints of the human 
body, and such data are put into a database as 

io knowledge regarding the basic motions. 

In order to develop a new skill, an analyst 
accesses the database and modifies the data. A 
computer can provide the analyst with feedback in 
real time on the result of constraints and on the 

75 result of inverse dynamics, and new skills can be 
developed in an interactive manner by repeating 
the above processes until satisfactory results are 
obtained. 

The computational complexity in this skill de- 
20 veloping method is a function 0(n) of the number 
of segments n in the model, so the computational 
complexity is greatly reduced. Furthermore, it is 
possible to describe realistic motions of the human 
body using a three-dimensional smooth modeling 
25 picture. 

Figure 1 is a flow chart of the method of the 
present aspect. It includes the following steps. 

(1) Constructing a model of the human body; 

(2) Applying the actual motions of a human to 
30 the model; 

(3) Analyzing the resulting motions of the model; 

(4) Developing new motions from basic motions; 

(5) Applying dynamics to the model; 

(6) Applying constraints to the model; 

35 (7) Applying inverse dynamics to the model; and 

(8) Displaying the result. 
In the first step (constructing a model), the 
human body is divided into a plurality of segments 
connected by joints, each of the segments acting 

40 as a minimal unit of motion. A model then is 
constructed on the basis of constraints including 
the nature of each segment, the articulation of the 
body, and the range of movement of the joints 
connecting the segments. Data defining the model 

45 are stored in a computer as a database. 

In the second step (applying actual motions), a 
film is taken of the actual motions of a human, and 
for each frame of the film, the positions of the body 
parts of the human are quantified and input to the 

so computer. This data is applied to the model, and 
the computer calculates the position, velocity, and 
acceleration of each segment of the model. When 
the human is simultaneously filmed from a plurality 
of directions, the analysis in the next step can be 

55 executed more zor,c:e:e\y. 

In the third step (analyzing the motions of the 
model), the motions of the segments determined in 
the second step are analyzed using inverse dy- 
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namics to determine the center of gravity of each 
body segment, the force and torque exerted on 
each joint, the position of the center of gravity of 
the whole body, and the force and torque exerted 
on the center of gravity of the whole body. When 
only the analysis of motions is desired, the center 
of gravity of each body segment, the force and 
torque exerted on each joint, the center of gravity 
of the whole body, and the force and torque ex- 
erted on the center of gravity of the whole body, 
which are obtained in the third step, are displayed 
on a screen by arrows or other symbols superim- 
posed on a display of the human body model. 

Next, a method for developing a new skill on 
the basis of the results of the preceding analysis 
will be explained. 

In order to develop a new skill, the data on the 
human body obtained in the first step, the data on 
the actual motions of the human body obtained in 
the second step, and the data on the results of the 
analysis obtained in the third step are previously 
input to the database. 

In the fourth step (developing new skills), an 
analyst chooses a plurality of basic motions from 
the database. The basic motions are represented 
quantitatively by control graphs each showing the 
force acting on one of the joints of the model as a 
function of time. Figures 2(a) - 2(c) are control 
graphs of the forces acting on the left elbow in the 
directions of x, y, and z orthogonal axes as a 
function of time. The two forces exerted on any 
given joint are equal in magnitude and opposite in 
direction. A complicated motion is represented by 
a plurality of graphs. The control graphs for mo- 
tions of other body segments can be designed in 
the same manner as for the illustrated control 
graphs for the left elbow. 

Next, global modification and local modification 
of forces are performed. Global modification in- 
volves producing a uniform change in forces acting 
on all the body segments. Local modification in- 
volves the modification of physical parameters 
such as the force exerted on a specific segment of 
the human body. 

In the fifth step (application of dynamics), the 
motion of each body segment is calculated on the 
basis of the forces corresponding to the basic 
motions selected by the analyst and the dynamic 
equations governing movement of the segments. In 
this calculation, although the articulation of the hu- 
man body is essentially as shown in Figure 3(a), 
each body segment is treated as being separate 
from the others to reduce the amount of computa- 
tion, and the constraints on the articulation of the 
/.LfTian oody and the range of movement or joints 
are neglected for the moment. 

In order to calculate the motion of each seg- 
ment, Newton's equation of motion is used to de- 



termine the linear acceleration of the center of 
gravity, and Euler's equations are used to derive 
the angular acceleration of each segment about its 
center of gravity. Once the linear and angular ac- 
celerations are obtained, they are integrated a first 
time to find velocities and integrated a second time 
to find positions. 

In the sixth step (application of constraints), the 
articulation of the human body and the range of the 
movements of body joints are checked for each of 
the motions calculated in the fifth step. The pro- 
cess of applying constraints starts at a segment 
referred to as a root segment, and the position and 
the orientation of each segment in a subclass of 
the root segment are checked sequentially. Here, 
two types of checks are performed. One is a check 
whether a subclass segment is always connected 
to its superclass segment. The other is a check 
whether the movement of each joint exceeds a 
specified range. If the subclass segment is not 
connected to its superclass segment as shown in 
Figure 4(a), the subclass segment is translated until 
it becomes connected to its superclass segment. If 
the movement of each segment joint exceeds the 
specified range, the movement of the joint is ad- 
justed to be within the range by rotation of the 
corresponding segment, thus modifying the posi- 
tions of the segments to obtain a posture as shown 
in Figure 4(b). 

In the seventh step (application of inverse dy- 
namics), Lagrange equations which describe the 
relationship between forces and movement are 
used to calculate the forces exerted on each joint 
of the body. 

If the desired results are not at first obtained, 
the 5th - 7th steps can be repeated, and the new 
motions can be developed in an interactive man- 
ner. 

In the eighth step (displaying the result), the 
new motions which have been partially or com- 
pletely designed are displayed on the screen. The 
position of the center of gravity of the human body 
and the direction of forces exerted thereon can be 
superimposed on the display of the human body. 
Furthermore, in the displaying step, the results 
obtained in the third step in which the motions of 
the model are analyzed can also be displayed. 

In the present invention, since the sequence is 
executed by a simple line feedback algorithm, the 
computational complexity of the inverse dynamics 
becomes a function O(n) of the number of seg- 
ments n. By using inverse dynamics, a reasonable 
and complete combination of forces can be ob- 
tained. In contrast, without inverse dynamics, it is 
impossible for tne analyst to find the complete 
design of forces. In the present invention, if the 
orientation of a body segment is such that the 
range of movement of either of its joints is ex- 
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ceeded, the orientation of the segment is changed 
so that the position of the body segment satisfies 
the physical constraints of the human body. Since 
the motions of the human body thus obtained are 
natural motions wherein a subclass segment is s 
always connected to its superclass segment and 
the movement of each joint does not exceed its 
specified range, such motions can be displayed 
realistically using a three-dimensional modeling 
picture. jq 

Furthermore, according to the present inven- 
tion, it is possible to develop a new motion in an 
interactive manner using a computer without requir- 
ing trial and error or the intuition of the analyst. 

As mentioned above, the skill developing meth- ;s 
od according to the present invention comprises 
the steps of analyzing the basic motions of an 
actual human body and developing new motions. 
The analysis of the basic motions of the human 
body is achieved in three steps: constructing a 20 
human body model, applying the actual motions of 
a human to the model, and analyzing the motions 
of the segments of the model. The development of 
new motions is achieved in three steps: application 
of dynamics, application of constraints, and ap- 25 
plication of inverse dynamics. In the step of apply- 
ing dynamics, the human body is divided into a 
plurality of independent body segments (50. for 
example) connected by joints, and the motion of 
each body segment is calculated independently of 30 
the other segments using Newton's equation of 
motion and Euler's equations. In the step of apply- 
ing constraints, the articulation of the body and the 
range of movement of the joints are checked. In 
the step of applying inverse dynamics, the force 35 
modified by the constraints and generating new 
forces are calculated. Thus, the whole computa- 
tional complexity becomes 0(n). 

Accordingly, the skill developing method ac- 
cording to the present invention can eliminate the 40 
computational complexity of conventional methods, 
it permits dynamics to be applied to actual skill 
development and it permits feedback in real time 
using dynamics. 

Furthermore, in order to calculate the motions 45 
of each segment of the human body, since the 
linear acceleration of the center of gravity is cal- 
culated using Newton's equation of motion and the 
angular acceleration of the center of gravity is 
calculated using Euler's equations, it is possible to 50 
determine and display not only the position of and 
the force exerted on the center of gravity of each 
segment, but also the position of and the force 
exerted on the center of gravity of the whole hu- 
man body. In other words; sinca the position of the 55 
center of gravity of the human body and the direc- 
tion and magnitude of the forces involved in the 
movement can be displayed, it is possible to easily 



teach the skill being developed. 

It is possible according to the present invention 
to realistically display the motions of a human body 
using smooth three-dimensional modeling pictures 
rather than line drawings. In addition, an analyst 
can look at the human body model on the screen 
from various directions, and can translate or rotate 
various segments of the human body in an inter- 
active manner. Thus, the analyst can ascertain the 
relationship between the picture and the human 
body model correctly. 

In conventional skill developing methods, basic 
data on the motions of the human body and the 
constraints that define the range of movements of 
individual joints are obtained using the intuition of 
the analyst. In contrast, in the skill developing 
method according to the present invention, actual 
dynamic parameters are obtained by analyzing the 
actual motions of the human body. Accordingly, the 
motions derived from these parameters are reliable 
and provide realistic motions. 

Claims 

1. A method of forming a numerical control pro- 
gram on the basis of the motions of a human, 
comprising: 

dividing a human body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing a model from the segments based 
on constraints including the inherent future of 
each segment and the articulation of the body 
and range of movement of each joint, and 
inputting the model into a database: 

applying actual motions of a human to the 
model; 

calculating the resulting motions of the 
model by inverse dynamics and calculating the 
center of gravity of each segment, the force 
and torque exerted on each joint, the center of 
gravity of the whole body, and the force and 
torque exerted on the center of gravity of the 
whole body: 

choosing a plurality of basic motions from 
the database and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the human body and the range of 
movements of the joints; 

checking and mortifying the physical con- 
straints on the articulation of the animal body 
and the range of movements of the joints; and 

displaying the resulting motions on a 
screen. 
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2. A method of forming a numerical control pro- 
gram on the basis of the motions of a human, 
comprising: 

dividing a human body into a plurality of 
segments connected by joints, each of the s 
segments acting as a minimal unit of motion, 
constructing a model from the segments based 
on constraints including the inherent future of 
each segment and the articulation of the body 
and range of movement of each joint, and to 
inputting the model into a database; 

applying actual motions of a human to the 
model; 

calculating the resulting motions of the 
model by inverse dynamics and calculating the rs 
center of gravity of each segment, the force 
and torque exerted on each joint, the center of 
gravity of the whole body, and the force and 
torque exerted on the center of gravity of the 
whole body; 20 

choosing a plurality of basic motions from 
the database and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 25 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the human body and the range of 
movements of the joints; 

checking and modifying the physical con- 30 
straints on the articulation of the animal body 
and the range of movements of the joints; 

calculating the relation between forces and 
motions caused by the modification of physical 
constraints using inverse dynamics; and 35 

displaying the result obtained by compos- 
ing the motions calculated by dynamics and 
the forces and centers of gravity calculated by 
inverse dynamics. 

40 

3. A method for developing a new computer ani- 
mation comprising: 

dividing a moving body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 45 
constructing a model of the moving body on 
the basis of constraints including the inherent 
future of each segment, the articulation of the 
body, and the range of the movement of each 
joint, and inputting the model into a database; so 

applying the actual motions of a moving 
body to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the cenrer of gravity of each segment, the 55 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 




ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the moving body and the range of 
movements of the joints; 

checking and modifying the physical con- 
straints on the articulation of the moving body 
and the range of movements of the joints; and 

displaying the resulting motions of the 
model on a screen. 

4. A method for developing computer animation 
comprising: 

dividing a moving body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing a model of the moving body on 
the basis of constraints including the inherent 
future of each segment, the articulation of the 
body, and the range of the movement of each 
joint, and inputting the model into a database; 

applying actual motions of a moving body 
to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the moving body and the range of 
movements of the joints; 

checking and modifying physical con- 
straints on the articulation of the moving body 
and the range of movements of the joints; 

calculating the relation between forces and 
the motions caused by the modification of 
physical constraints using inverse dynamics; 
and 

displaying the result obtained by compos- 
ing the motions calculated by dynamics and 

the forces and canters of gravity calculated by 
inverse aynamics. 

5. A method for developing a new training motion 
for training an animal, comprising: 
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dividing an animal body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing an animal body model on the 
basis of constraints including the inherent fu- s 
ture of each segment, the articulation of the 
body, and the range of the movement of each 
joint, and inputting the animal body model into 
a database; 

applying the actual motions of an animal . io 
body to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the ;s 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 20 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 25 
ticulation of the animal body and the range of 
movements of the joints; 

checking and modifying the physical con- 
straints on the articulation of the animal body 
and the range of movements of the joints; and 30 

displaying the resulting motions of the ani- 
mal model on a screen. 

6. A method for developing a new training motion 

comprising: 35 

dividing an animal body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing an animal body model on the 
basis of constraints including the inherent fu- 40 
ture of each segment, the articulation of the 
body, and the range of the movement of each 
joint, and inputting the animal body model into 
a database; 

applying actual motions of an animal body 45 
to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the 50 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 55 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 



tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the animal body and the range of 
movements of the joints; 

checking and modifying physical con- 
straints on the articulation of the animal body 
and the range of movements of the joints; 

calculating the relation between forces and 
the motions caused by the modification of 
physical constraints using inverse dynamics; 
and 

displaying the result obtained by compos- 
ing the motions calculated by dynamics and 
the forces and centers of gravity calculated by 
inverse dynamics 

7. A robot programming method comprising: 

. dividing a human body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing a human body model on the basis 
of constraints including the inherent future of 
each segment, the articulation of the body, and 
the range of the movement of each joint, and 
inputting the human body model into a 
database; 

applying the actual motions of a human 
body to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 

dividing the robot into a plurality of seg- 
ments connected by joints and calculating the 
motions of each robot body segment when 
forces corresponding to the basic motions are 
applied to the robot body segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the robot body and the range of 
movements of the robot body joints; 

checking and modifying the physical con- 
straints on the articulation of the robot body 
segments and the range of movements of the 
robot body joints; and 

displaying the resulting motions of the ro- 
bot body on a screen. 

8. A robot programming method comprising: 

dividing a human body into a piuraiity of 
segments connected by joints, each of the 
M segments acting as a minimal unit of motion, 
constructing a human body model on the basis 
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of constraints including the inherent future of 
each segment, the articulation of the body, and 
the range of the movement of each joint, and 
inputting the human body model into a 
database; s 

applying the actual motions of a human 
body to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the w 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 15 
the database, and modifying physical param- 
eters of the basic motions; 

dividing the robot into a plurality of seg- 
ments connected by joints and calculating the 
motions of each robot body segment when 20 
forces corresponding to the basic motions are 
applied to the robot body segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the robot body and the range of 
movements of the robot body joints; 25 

checking and modifying physical con- 
straints on the articulation of the robot body 
and the range of movements of the robot body 
joints; 

calculating the relation between force and 30 
the motions caused by the modification of 
physical constraints using inverse dynamics; 
and 

displaying the results obtained by compos- 
ing the motions calculated by dynamics and 35 
the forces and centers of gravity calculated by 
inverse dynamics 

9. A method for developing a new sport motion 

comprising: 40 

dividing a human body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing a human body model on the basis 
of constraints including the inherent future of 45 
each segment, the articulation of the body, and 
the range of the movement of each joint, and 
inputting the human body model into a 
database; 

applying the actual motions of a human 50 
body to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force anc torque exerted on each joint, the 55 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 



choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the human body and the range of 
movements of the joints; 

checking and modifying the physical con- 
straints on the articulation of the human body 
and the range of movements of the joints; and 

displaying the resulting motions of the hu- 
man model on a screen. 

10. A method for developing a new training motion 
comprising: 

dividing a human body into a plurality of 
segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing a human body model on the basis 
of constraints including the inherent future of 
each segment, the articulation of the body, and 
the range of the movement of each joint, and 
inputting the human body model into a 
database; 

applying actual motions of a human body 
to the model; 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the human body and the range of 
movements of the joints; 

checking and modifying physical con- 
straints on the articulation of the human body 
and the range of movements of the joints; 

calculating the relation between forces and 
the motions caused by the modification of 
physical constraints using inverse dynamics; 
and 

displaying the result obtained by compos- 
ing the motions calculated by dynamics and 
the forces and centers of gravity calculated by 
inverse dynamics. 

11. A skill developing method comprising: 

dividing a human body into a plurality of 
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segments connected by joints, each of the 
segments acting as a minimal unit of motion, 
constructing a human body model on the basis 
of constraints including the inherent future of 
each segment, the articulation of the body, and 5 
the range of the movement of each joint, and 
inputting the human body model into a 
database; 

applying the actual motions of a human 
body to the model; w 

calculating the resulting motions of the 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 75 
force and torque exerted on the center of grav- 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 20 

calculating the motions of each segment 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 
ticulation of the human body and the range of 25 
movements of the joints; 

checking and modifying the physical con- 
straints on the articulation of the human body 
and the range of movements of the joints; and 

displaying the resulting motions of the hu- 30 
man model on a screen. 

12, A skill developing method comprising: 

dividing a human body into a plurality of 
segments connected by joints, each of the 35 
segments acting as a minimal unit of motion, 
constructing a human body model on the basis 
of constraints including the inherent future of 
each segment, the articulation of the body, and 
the range of the movement of each joint, and 40 
inputting the human body model into a 
database; 

applying actual motions of a human body 
to the model; 

calculating the resulting motions of the 45 
model using inverse dynamics and calculating 
the center of gravity of each segment, the 
force and torque exerted on each joint, the 
center of gravity of the whole body, and the 
force and torque exerted on the center of grav- 50 
ity of the whole body; 

choosing a plurality of basic motions from 
the database, and modifying physical param- 
eters of the basic motions; 

calculating the motions of each segment 55 
when forces corresponding to the basic mo- 
tions are applied to the segments using dy- 
namics while neglecting constraints on the ar- 



ticulation of the human body and the range of 
movements of the joints; 

checking and modifying physical con- 
straints on the articulation of the human body 
and the range of movements of the joints; 

calculating the relation between forces and 
the motions caused by the modification of 
physical constraints using inverse dynamics; 
and 

displaying the result obtained by compos- 
ing the motions calculated by dynamics and 
the forces and centers of gravity ca- 
lculated by inverse dynamics. 
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